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Abstract 

This article aims at revisiting, with the aid of simple and neat numerical exam¬ 
ples, some of the basic features of macroscopic irreversibility, and, thus, of the 
mechanical foundation of the second principle of thermodynamics as drawn by 
Boltzmann. Emphasis will be put on the fact that, in systems characterized by 
a very large number of degrees of freedom, irreversibility is already manifest at 
a single-trajectory level for the vast majority of the far-from-equilibrium initial 
conditions - a property often referred to as typicality. We also discuss the im¬ 
portance of the interaction among the microscopic constituents of the system 
and the irrelevance of chaos to irreversibility, showing that the same irreversible 
behaviours can be observed both in chaotic and non-chaotic systems. 


1. Introduction 

Everyday experience demonstrates that many natural processes are intrinsi¬ 
cally irreversible at the macroscopic level. Think of a gas initially confined by 
a septum in one half of a container, that spontaneously fills the whole available 
volume as soon as the separator is removed. Or, closer to daily experience, 
consider the evolution of an ink drop into water [l|. We would be astounded 
and incredulous while observing the reverse processes to occur spontaneously: 
a gas self-segregating in one half of the container, or an ink drop emerging from 
a water-and-ink mixture. In thermodynamics, the second principle amounts to 
a formalization of this state of “incredulity”. From Newtonian (and quantum) 
mechanics, we know that at the microscopic level the dynamics is reversible. 
How can we reconcile macroscopic irreversibility with microscopic reversibility 
of the dynamics ruling the elementary constituents of macroscopic bodies? 

A solution to this riddle was proposed more than 140 years ago, when Boltz¬ 
mann laid down the foundation of statistical mechanics. At the beginning, 
Boltzmann’s ideas on macroscopic irreversibility elicited a heated debate mainly 
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due to the recurrence paradox^ formulated by Zermelo, and the reversibility para¬ 
dox by Loschmidt (a detailed discussion on the historical and conceptual aspects 
of the Boltzmann’s theory can be found in Refs. [1,0). In spite of several rigor¬ 
ous mathematical results ii supporting, with a clear physical interpretation 
(at least for many scientists, including the authors of this paper), the coherence 
of the scenario proposed by Boltzmann, irreversibility still remains a somehow 
misinterpreted and controversial issue, even among researchers in the field. The 
reader may appreciate some of the opinions from the comments 0 to a paper 
by Lebowitz on Boltzmann’s “time arrow” [ij. 

According to Boltzmann, irreversibility is well defined only for systems with 
a very large number of degrees of freedom. It should be observed in the vast 
majority of the individual realizations of a macroscopic system starting far from 
Muilibrium: “vast majority” is usually referred to as typicality in the literature 
[a 0 (see next section for further details). Hence, there is no need to repeat 
the experiment many times to understand that the free-gas expansion or the 
spreading of an ink drop in the water are irreversible processes, a single ob¬ 
servation is enough. Conversely, for some authors irreversibility can only be 
properly defined through the use of ensembles. Also, there is not general agree¬ 
ment on the fact that irreversibility is an emergent property when the number 
of degrees of freedom becomes (sufficiently) large. For instance, Prigogine and 
his school claim that Irreversibility is either true on all levels or on none: it 
cannot emerge as if out of nothing, on going from one level to another 0/. For 
others, irreversibility results from (microscopic) chaotic dynamics, or, it is a 
mere consequence of the interaction with the external environment. 

Likely due to this maze of different opinions, often there is a persistence of 
confusing and conflicting ideas about macroscopic irreversibility in spite of clear 
discussions of the subject in the recent past Sis- 

This article aims at supplementing some aspects of Boltzmann’s explanation 
of macroscopic irreversibility which are often sources of misinterpretation with 
simple and neat numerical examples. In particular, the article focuses on the 
behavior of macroscopic observables that can be measured in laboratory exper¬ 
iments. Boltzmann’s solution to the reversibility and recurrence paradoxes will 
be mainly left aside as it already widely discussed in the literature (see, e.g., 
0111 ). Instead, emphasis will be put on the fact that irreversibility is a prop¬ 
erty of the single realization of a macroscopic system in which an important role 
is played by the (even very weak) interaction among its elementary constituents. 
In fact, although irreversible behavior can be manifest also in systems of non¬ 
interacting units (see Ref. [l^ for a pedagogical presentation of irreversibility 
in the case of non-interacting gas free expansion), in the absence of interactions 
single-particle and ensemble properties trivially coincide leading to some am¬ 
biguity in the interpretation of irreversibility. Finally, to stress the generality 
of the ideas, simple models, which can be studied by standard simulation tech¬ 
niques, will be considered. In particular, the comparison between chaotic and 
non-chaotic systems will underline the irrelevance of chaos to irreversibility. 

The paper is organized as follows. In Section [2] we briefly survey the con¬ 
ceptual aspects of Boltzmann’s approach, and discuss the entropy, the use of 
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ensembles and the role of chaos. Moreover we present some explicit calculations 
performed in a Markovian model introduced by P. and T. Ehrenfest 1^. In 


Sect. O we consider numerical examples of macroscopic irreversible behaviors 
by studying deterministic systems involving particles which collide with a mov¬ 
ing wall. In section 01 we discuss a numerical experiment conceptually alike 
to the irreversible mixing of an ink drop into water. Section [S] summarizes the 
main aspects of our understanding of macroscopic irreversibility on the light of 
Boltzmann’s ideas. 


2. Basic facts on macroscopic irreversibility 

We start recalling some basic notions. In Classical Mechanics (quantum sys¬ 
tems will not be treated here) a macroscopic body, is fully described once we 
specify its microstate X(t) = ... ^XNit)) = ; qN{t),pN{t)) 

characterized by the position qi and the momentum pi of its N elementary con¬ 
stituents, say particles. The whole set of admissible microscopic configurations, 
{Jt}, defines the phase space, or P-space. The evolution of a macroscopic system 
from an initial state X(0) at time 0 up to a specified time T > 0, {X(t)}^g, 
constitutes a “forward” trajectory. The time “reversed” trajectory is obtained 
by applying the time reversal transformation TZ, i.e. considering as initial state 
the one with particles at the positions reached at time T but with reversed veloc¬ 
ities, i.e. X’^(O) = 7^(X(T)) = (qi(T),-pi(r);...;q^(r),-pjv(r)). When 
the system is evolved from X^(0), thanks to the invariance of Newton’s equa¬ 
tions under time reversal, it traces back the forward trajectory (with reversed 
velocities) as if the evolution movie were played backwards, i.e. given 0 < t < T, 

X^(t) = n{X{T-t)). 

From Thermodynamics, we know that the macrostate of a large system 
{N ^ 1) is specihed by a small number of macroscopic observables, Ma{t) = 
Ma{X{t)) with a = <C N. The observables to be qualified as 

“macroscopic” must depend on a large number of the system degrees of free¬ 
dom. In general, we have that many microscopic configurations correspond to 
the same value of the observables, in other terms the relation between micro 
and macro state is many to one. Some examples are the energy of a subsys¬ 
tem composed of many particles, the number density in specific (not too small) 
regions, or the number of particles with velocity in a given interval. At equilib¬ 
rium the macroscopic observables assume specific values = {Ma)eq, where 
{■)eq denotes the equilibrium average with respect to, e.g., the microcanonical 
distribution (in principle, other ensembles can be used, we use here the micro- 
canonical one as it is the appropriate one for the numerical examples discussed 
in the next sections). We can define a state to be far from equilibrium when the 
observables deviate from their equilibrium values well beyond the equilibrium 
fluctuations, in other terms when \\Ma — cr^ = ■ 

Conversely, whenever \ \Ma—M^'^\ \ fv tr^ we speak of close-to equilibrium states. 

Macroscopic irreversibility refers to the fact that when starting from far-from 
equilibrium states, the (macroscopic) system evolves toward equilibrium, i.e. at 
times long enough we have that Ma{t) —>■ M^, while we never observe the 
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opposite, i.e. that starting close to equilibrium the system approaches (spon¬ 
taneously) a far from equilibrium state, in spite of the fact that such reversed 
trajectories would be perfectly compatible with the microscopic dynamics^ 

Boltzmann explained the asymmetry in the time evolution of macroscopic 
systems in term of a probabilistic reasoning. He realized that the number of 
microscopic configurations corresponding to the equilibrium state, i.e. X such 
that Ma{X) ft! is, when the number of degrees of freedom N is very 

large, astronomically (i.e. exponentially in ivj^ larger than those corresponding 
to non-equilibrium states. Somehow “intuitively” it is overwhelmingly “more 
probable” to see a system evolving from a very “non-typical” state, i.e. which 
can be obtained with (relatively to equilibrium) a negligible number of micro¬ 
scopic configurations, towards an equilibrium state, which represents a huge 
number of microscopic states, than to see the opposite. This “intuitive’H notion 
of “more probable” can be formalized in terms of the Boltzmann’s entropy of a 
given macrostate, which is the log of the number of microstates corresponding 
to that macrostate, one of the greatest contribution of Boltzmann was to iden¬ 
tify such entropy with the thermodynamic entropy when in equilibrium. These 
entropic aspects have been (beautifully and thoroughly) discussed in other ar¬ 
ticles [11,0,II3|, to which we refer to. 

In the case of very dilute (monoatomic) gases, Boltzmann was even able to do 
more, with his celebrated H-theorem, by demonstrating the irreversible dynam¬ 
ics of the one-particle empirical distribution functioifl fi{x, t) = -^ ~ 

Xiit )), where x = (q,p) denotes the position and momenta of a single par¬ 
ticle, i.e. the so-called /r-space. The interesting aspects about the empirical 
distribution are that fi is a well defined macroscopic observable and can be, 
in principle, measured in a single system, e.g. in numerical simulation. In an 
appropriate asymptotics (the so-called Boltzmann-Grad limit, see Ref.0 for 
details) the evolution of fi is well described by a deterministic equation - the 
Boltzmann’s equation. This equation, via standard derivations (see, e.g., Ref. 
[HI; 113) predicts an asymmetry in the evolution of the quantity 

H(t) = kBjfi{x,t)lnfi{x,t)dx. (I) 

In other terms, the iJ-theorem states that if the system is truly macroscopic, 
i.e. N is huge (which allows us to consider a single system and to describe it at 
a macroscopic level by using the empirical distribution), if its initial state is far 
from equilibrium, the function H (t) cannot increase (but for small fluctuations) 


^Obviously, weakly interacting particles, in an empty infinite space, can spontaneously 
leave the region where they were initially released and never return there M- This form of 
irreversibility is quite trivial, so we shall only consider systems evolving in a bounded region 

of r. 

^ Since in macroscopic bodies N is order the Avogadro number, Na ~ 10^^ we are speaking 
here of hard to imagine larger numbers when the exponential is taken. 

^Intuitive only a posteriori and in a very subtle way indeed. 

"^Here, we define it through Dirac-deltas from a mathematical point of view we should 
always think to some regularization via, e.g., some coarse-graining. 
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ESQ. In particular, it is maximal at equilibrium, which for a dilute gas 
implies uniform distribution in the spatial coordinate and Maxwell-Boltzmann 
distribution for the velocities, where it is nothing but minus the Boltzmann’s 
entropy Ssit) = —H(t) and thus the thermodynamic entropy. 

The main criticisms to the first formulation of the i/-theorem boil down to 
the well known reversibility and recurrence paradoxes. The former, formulated 
by Loschmidt, states that the invariance under time reversal of Newton’s me¬ 
chanics implies that time-reversed trajectories have nothing exceptional (from 
a microscopic point of view) with respect to forward ones, so that such reversed 
trajectories can be used to “invert” the theorem and thus to show that H{t) 
must increase, i.e. the entropy must decrease. The criticism by Zermelo was 
based on Poincare recurrence theorem: the state of a mechanical system, evolv¬ 
ing in a bounded phase space region, will return infinitely close to the initial 
state, so that there will be a time at which H{t) will come back to the original 
value, again contradicting the theorem. 

The Boltzmann’s solution to these paradoxes has been discussed in many 
texts and manuals (see e.g. , and thus will not be discussed in details 

here. We simply recall that, given the macroscopic nature of the system the 
Poincare time can much larger than the age of the universe in a true macroscopic 
body and that, as mentioned before, the number of microstate corresponding to 
equilibrium is astronomically large with respect to those far from equilibrium, 
justifying the typicality of macroscopic irreversibility. 

In the sequel we shall focus, within the framework of specific examples, on 
the fact that macroscopic irreversibility is well defined in a single realization 
(i.e. no need to average over the initial probability density), which is again 
a manifestation of the aforementioned typicality. Before entering the specific 
examples, it is useful to briefly recall some ideas about the role of ensembles 
and chaos on the notion of irreversibility, as their relevance to the latter might 
be subject of a certain confusion. 

2.1. Ensembles, chaos and entropy 

Although the importance of probabilistic methods in statistical mechanics 
cannot be underestimated, it is necessary to answer the following question: what 
is the physical link between the probabilistic computations (i.e. the averages 
over an ensemble) and the actual results obtained in laboratory experiments 
which, a fortiori, are conducted on a single realization (or sample) of the system 
under investigation? 

The answer of Boltzmann is well captured by the notion of typicality , i.e. 
the fact that the outcome of an experiment on a macroscopic system takes a 
specific (typical) value overwhelmingly often. In statistical mechanics typical¬ 
ity holds in the thermodynamic limit (and thus for ^ I). It is in such an 
asymptotics that the ratio between the set of typical (equilibrium) states and 
non-typical ones goes to zero extremely rapidly (i.e. exponentially in N), thus 
it is only when N is large that the probability to see the irreversible dynamics 
of initially far-from equilibrium macrostates towards equilibrium ones becomes 
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(at any practical level) one. The concept of typicality is not only at the ba¬ 
sis of the second law, but (possibly at a more fundamental level) in the very 
possibility to have reproducibility of results in experiments (on macroscopic ob¬ 
jects) or the possibility to have macroscopic laws Q. Consider a system with 
N particles, and a given macroscopic observable Mn{X). Let us assume an 
initial well behaving phase-space density p{X,0) prescribing a given macro¬ 
scopic state. From a physical point of view we can assume, e.g, p{X,0) = 0 
if M]\f{X) ^ [Mo : Mo -I- AM], for some Mg (usually chosen far from equilib¬ 
rium) with AM/Mq 1, that is we consider that one or more (macroscopic) 
constraints on the dynamics are imposed. Then we consider the ensemble of 
the microstates compatible with that constraint. Common examples are, e.g., a 
gas at equilibrium confined in a portion of the container by some separator (see 
next Section for some numerical examples). At time t = 0 such constraints are 
released and we monitor the evolution of the system by looking at the macro¬ 
scopic observable MN{X{t)): we denote with {M]s[{t)) the average over all the 
possible initial conditions weighted by p(X,0). If A ^ 1 and the initial state 
is far from equilibrium ||Mo — M®^|| cr^, according to the “Boltzmann’s 
interpretation” of irreversibility, the time evolution of Mjv(t) must be typical 
i.e. apart from a set of vanishing measure (with respect to p{X{0), 0)), most of 
the initial conditions originate trajectories over which the value of MM{X{t)) is 
very close to its average {M^it)) at every time In other terms, if N is large, 
behaviors very different from the average one (e.g. a ink drop not spreading in 
water) never occur: 

Prob{ M^it) ~ {Mi<i{t)) } Ri 1 when N ^ 1. (2) 

The rigorous proof of the above conjecture is very difficult and, of course, it is 
usually required to put some restrictions. It is remarkable that, as we will see in 
the next subsection, it is possible to show the validity of this property in some 
stochastic systems. 

The use of probability distribution to introduce the idea of typicality, as 
from the discussion above, should not convince the reader that irreversibility is 
a probabilistic notion. In particular, one should be careful to avoid the confusion 
between irreversibility and relaxation of the phase space probability distribu¬ 
tion. If a dynamical system exhibits “good chaotic properties”, more precisely, 
it is mixing, a generic probability density distribution of initial conditions, the 
ensemble, p{X, 0), relaxes (in a suitable technical sense) to the invariant distri¬ 
bution for large times t 

p(X,t)^p™(X) . (3) 


^From a mathematical point of view this means that it has to be absolutely continuous 
with respect to the Lebesgue measure. 

®Such property does not hold for all the observables in all situations, for instance one has 
to exclude situations in which the macroscopic dynamics is unstable. In this case the transient 
to equilibrium may vary from realization to realization though the final equilibrium state will 
be reached by almost all the realizations. 
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It is worth remarking that in systems satisfying Liouville theorem, the relaxation 
to the invariant distribution must be interpreted in a proper mathematical sense: 
for every e > 0 and for every X, one has 


[ p{Y,t)dY^ [ p^^^{Y)dY. 

J\X-Y\<e J\X-Y\<e 


|X-T|<e 


( 4 ) 


We want to make clear here that the property ((S]) or, equivalently, 0 is 
a form of irreversibility completely unrelated to the second law of thermody¬ 
namics. In fact, it does not require large systems as it can be observed even 
in dynamical systems with few degrees of freedom (see also the discussion on 
Sect. SI), for which no meaningful set of macroscopic observables can be defined. 

It is worth reporting that some authors have a different opinion. For ex¬ 
ample, in his comment to Lebowitz paper, [l[ Driebe states that irreversible 
processes can be observed in systems with few degrees of freedom, such as 
the baker transformation or other reversible, low-dimensional chaotic systems. 
However, one must appreciate that, in such low-dimensional chaotic systems, 
irreversibility due to the mixing property is observed only by considering en¬ 
sembles of initial conditions, while single realizations do not show a preferential 
direction of time. This occurs also in macroscopic systems when we monitor 
the evolution of an observable that is not macroscopic, e.g. a single molecule 
property either in the gas or in the ink drop. In that case, nothing astounding 
happens by looking at the forward or reversed trajectory, as we cannot decide 
the direction of the process. For a critical discussion of the role of chaos in 
irreversibility see Ref. Q . 

A trivial consequence of interpreting Eq. 0 and © as a form of irreversibil¬ 
ity is that systems of iV I non interacting particles, with a chaotic behavior, 
would exhibit irreversibility, also in the thermodynamic sense [l5| . However it is 
clear that this cannot be the case: in fact, some sort of (even weak) interaction 
among the particles is necessary to observe genuine thermodynamic behaviors 
and thus irreversibility. This can be easily understood considering a system with 

^ 1 independent particles in a box: suppose that the initial velocities of the 
particles labeled by z = I,...,A^/2 are extracted from a Maxwell-Boltzmann 
distribution at the temperature Ti, and that the others, i = N/2 + 1,... ,N, are 
extracted from the same distribution, but at a different temperature T 2 . In the 
absence of interaction, the absolute value of the momentum of each particle \pi \ 
does not change and, as a consequence, the time evolution of some macroscopic 
observables (e.g. M{X) = ^oes not tend to the microcanonical 

equilibrium value. 

Such an elementary remark underscores that some degree of interaction 
among particles constitutes an unavoidable ingredient for a correct thermo¬ 
dynamic behavior. 

In discussing irreversibility, some authors define the entropy using the proba¬ 
bility distribution function (PDF) in the F-space, p{X, t). This way one obtains 
the so-called Gibbs entropy 


Sait) 


—ks 


p{X,t) \np{X,t)dX . 


( 5 ) 
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However, Sq can only be defined over an ensemble, otherwise p is meaningless. 
As a consequence, Sa{t) is accessible only in numerical experiments with sys¬ 
tems composed by few degrees of freedom. But, more crucially, it is unclear 
how to relate Sq to irreversibility because Liouville theorem implies that Sait) 
must stay constant over time! 

In order to observe an increase over time for S'c-like quantities, many authors 
introduce a coarse-graining of the F-space, amounting to consider a partition of 
the phase space in cells of size e and to define the probability Pj{t, e) that the 
state X visits the j-ih cell at time t. In this way we obtain the coarse-grained 
Gibbs entropy 

3 

Now for e > 0, turns to be an increasing function of time. However, it can 
be numerically shown that, for e > 0, the quantity remains constant up 

to a crossover time G ~ ln(l/e), after which it starts increasing. Clearly, this 
e-dependence indicates that the growth is a mere artifact of the coarse-graining 
and it is unrelated to irreversibility, though it can be of some interest in the 
study of dynamical systems [l^ . 

2.2. Typicality and irreversibility in the Ehrenfest model 

Let us now briefly discuss the meaning of typicality in a simple stochastic 
example, where explicit computations can be performed. This simple Markov 
chain was introduced by P. and T. Ehrenfest [1^ to illustrate some aspects of 
Boltzmann’s ideas on irreversibility. According to Kac [13 this Markov chain is 
probably one of the most instructive models in the whole of Physics and, although 
merely an example of a finite Markov chain, it is of considerable independent 
interest. 

Consider N particles, each of which can be either in one box (A) or in another 
{B). The state of the Markov chain at time t is identified by the number, nt, 
of particles in A and the evolution of the state is stochastic. The transition 
probabilities for the state nt = n to become nt+i = n ± I are given by 

n n 

Pn^n—l = 'Yf and Pji^n+l =1 J (7) 


respectively. 

We can now re-interpret the model in the language of statistical mechanics. 
The state of the Markov chain nt = n, at time t, can be seen as the “macro¬ 
scopic” state (M) of the system, the corresponding “microscopic” configuration 
is defined by the (labeled) particles which are effectively in box A. What is 
equilibrium in this model? Intuitively, n^q = N/2 as it corresponds to the state 
which can be realized with the largest number of microscopic configurations. 
Like in the free expansion, at equilibrium the gas fills equally (on average) both 
halves of the container. The simplicity of the model allows us to monitor the 


evolution of an ensemble of initial conditions starting from state no by ana¬ 
lytically computing the evolution of (nt) and = {nf) — {nt)'^, introducing 
^0 = no — N/2: 



Essentially, Eq. (|S]) tells us that (nt) —>■ Ueq = Nj2 exponentially fast with 
a characteristic time Tc = —[ln(l — — N/2, while Eq. (|9]) implies that 

also the standard deviation at goes to its equilibrium value /2 with a 

characteristic time 0{N/2). This is fine at the level of the (ensemble) average 
behavior, what can we tell for the single trajectory? 

It is easy to see that the single trajectory is also “typical” in the sense (ED, 
i.e. it should basically behave as the average trajectory, at least, if N is large 
enough. Consider a far-from-equilibrium initial condition, no — N\ it is easy to 
prove that, if iV ^ 1, until a time 0{N/2), i.e. as long as nt remains far from 
n^q each single realization of nt stays “close” to its average. Indeed, Chebyshev 
inequality sets the bound 


Prob 


[ \nt - {nt)\ 
V {nt) 



< 




(nt)^^ 


( 10 ) 


for the probability that nt deviates from its mean more than a small percentage 
e. From Eq.® and Eq.®, we obtain the bound a//{nt) = 0{1/N). Then, 
back to Eq. (1101) we have that for every e at will, there exists an such that, 
with probability ~ 1, each nt stays close its average if nt — neq ^ VN/ (i.e. 
at time t the system is still far from equilibrium). The above result means 
that we will observe an irreversible tendency to reach the equilibrium value in 
any single trajectory. Conversely, if no ~ ngg, i.e. |Ao| = \no — neq\ ^ 
we cannot distinguish the initial condition from a spontaneous fluctuation from 
equilibrium. 

In the Ehrenfest model, it is possible to show that for A 1 and far enough 
from equilibrium (i.e. \no — N/2\ ^ 0{^/N)), both the Zermelo and Loschmidt 
paradoxes (suitably reinterpreted in the context of this Markov chain model) 
are physically irrelevant, see Ref. [13 for a detailed discussion. 

The Ehrenfest urn-model is a useful example to illustrate some basic aspects 
of Boltzmann’s viewpoint, even though the stochastic nature of the model might 
seem too far from the “mechanical context” where irreversibility is traditionally 
discussed. Nevertheless, this model maintains some similarities with determin¬ 
istic Hamiltonian systems. For instance it is easy to show that it satisfies the 
detailed balance property P{nt = *;nt+i = j) = Pint = j]nt+i = i), that is 
the stochastic equivalent of microscopic reversibility |17| . In the following, we 
present numerical examples of Hamiltonian systems showing the scenario here 
discussed remains basically unchanged also in the deterministic world. 
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3. Irreversibility in large deterministic Hamiltonian systems 

In this section, we study two examples of many particle Hamiltonian systems 
in which the volume available to the particles is constrained along a direction by 
a moving wall (a piston). The position of the piston is a macroscopic observable, 
corresponding to the volume occupied by the system at a certain time, and there¬ 
fore can exhibit an irreversible behavior when initialized in a non-equilibrium 
state. We will consider both interacting and non-interacting particles. However, 
we emphasize that even when the gas particles do not interact directly, they do 
it indirectly via the collisions with the moving wall (piston). 


3.1. A mechanical model of thermometer 

We start from the following mechanical model; a pipe, containing N particles 
of mass TO, is horizontally confined, on the left, by a fixed wall and, on the right, 
by a wall free to move without friction (the piston), of mass M, whose position 
changes due to collisions with the gas particles and under the action of a constant 
force F. We consider two actualizations of the system with and without direct 
interaction among particles. As discussed in the following, the latter system is 
chaotic while the former is not, therefore their comparison provides a test on 
the role of chaos in macroscopic irreversibility. 

In the non-interacting gas case, the Hamiltonian reads 


N 




i=l 


EL 

2m 


p2 

2M 


FX. 


( 11 ) 


plus terms accounting for the interactions with the walls against which the 
particles collide elastically. Particle momenta are denoted with pi while X and 
P are the piston position and momentum, respectively. 

The equilibrium statistical properties of the system can be easily computed 
using the microcanonical ensemble 18, M- At equilibrium, the gas particles 


are uniformly distributed within the available volume, in particular the horizon¬ 
tal coordinate Xi is uniform in [0 : X], with velocities following the Maxwell- 
Boltzmann distribution at the equilibrium temperature, T^q. We can easily 
compute the equilibrium values. 


T — 

eq — 


2NDTo + 2FXo 
N{D + 2) + 3 


X. 


eq 


= («+l)^ 


= a(D)VNl^+o(XN) ( 12 ) 


F 


where a{D) is a constant depending on the system dimensionality D: a{D = 
1) = l/-\/3, a{D = 2) = and from now on we work in units such that 

fcs = 1. Eqs. (113 show that the piston position provides a measure of the 
temperature, once F and X are given. We notice that the average becomes more 
and more sharp, as N increases. It is worth emphasizing 

that, in the absence of interactions, the horizontal axis is the only relevant 
direction. For this reason numerically we have studied it in one dimension. 

We conclude the presentation of the non-interacting gas model by empha¬ 
sizing that the whole system is not chaotic, i.e. it has vanishing Lyapunov 
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exponents. The dynamics of the non-interacting gas plus piston can be mapped 
into that of billiard whose boundary is a polyhedron, and thus with zero curva¬ 
ture. It is a known fact that for billiards in with zero-curvature boundaries (and 
thus, for our mechanical model) all Lyapunov exponents do vanish, though the 
system can still be ergodic (20| . 

In the interacting gas case, we consider a two-dimensional pipe, of cross- 
section L, with qi = [xi, yi) and Pi = (pf, pf). The Hamiltonian is obtained by 
adding to Eq. m the interaction potential, so that 

n = no + J2 - ^^'l) + uUqu- • ■, gn, ^) • (i3) 

i<i' 

We consider repulsion between particle pairs, U{rij) = Uo/rj^, and with the 
four walls, Uw{R) = Uq/R^'^, where R denotes the particle-wall distance. The 
right wall is the frictionless piston. Previous numerical investigations [l9| have 
shown that at low densities the system behaves like a two-dimensional ideal gas. 
From a quantitative point of view, there will be corrections (whose calculation 
is not of interest here) with respect to the equilibrium values (TT^ (for D = 2) 
due to the interaction energy. Interestingly for our discussion here, the major 
qualitative difference with respect to the non-interacting gas is a dynamical 
one: due to the non-linear interactions among the particles, now the system is 
chaotic, as demonstrated in Fig. [21 

We now discuss irreversibility by following the time evolution of the piston 
position in the interacting and non-interacting case. At time t = 0, we fix the 
position of the piston A(0) = Xq, its velocity F(0) = 0, and set the initial 
microscopic state as an equilibrium configuration of the gas in the volume im¬ 
posed by the piston position at a given temperature Tq. In practice, we take 
the gas particles uniformly distributed in [0 : Xq] (in the two-dimensional case, 
in [0 : Aq] X [0 : L]) with a Maxwell-Boltzmann distribution of velocities at 
temperature Tq. 

We run molecular dynamics simulation by using event-driven schemes in 
the non-interacting gas and Verlet algorithm with time step At = 10“^ in the 
interacting one (see caption of Fig. |T] for specific parameters). As expected, 
numerical simulations show that when the initial state is sufficiently far from 
from equilibrium, meaning that |Ao — Xeq\ ^ its evolution X{t) exhibits 
an irreversible behavior. 

Figure[TJi reports a single trajectory, X{t), and the behavior of the ensemble 
average, (A(t)), obtained by repeating the simulation from the same macro¬ 
scopic initial condition (the same Xq and Tq) but different microscopic initial¬ 
izations of the gas particles. We fixed |Ao — Xeq\ « 10 In analogy with the 
Ehrenfest model, we observe that the average trajectory is also typical: far from 
equilibrium, fluctuations are small compared to the ensemble average value. In 
other words, for almost every initial configuration of the system compatible with 
the macroscopic state, the time evolution of the piston position is practically 
identical to the average one. The standard deviation of the position, axit)-, as 
shown in the inset of Fig. [1^, evolves from the initial value 0 (by construction) 
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and reaches the equilibrium value at long time, similarly to the Ehrenfest model 
but with a richer and more complex phenomenology. In particular, we notice the 
non-monotonic behavior of crx{t) in the short-time oscillatory phase. Similar 
behaviors are not uncommon for systems starting from an unstable state 211. 


However, and interestingly for our discussion, crx{t) remains small with respect 
to the average value. We can thus observe macroscopic irreversibility in a single 
trajectory of macroscopic system initialized in a non-equilibrium initial state. 

The interacting particle system (1131) qualitatively displays the same behavior 
(Fig. [T}d) supporting the statement that (microscopic) chaos does not add any 
new relevant feature to macroscopic irreversibility. 

Figure [3^ displays the typical evolution from a (close-to) equilibrium initial 
condition, i.e. \Xq — X, 


eq\ 


eg 
’X 1 


in the non-interacting gas system. As one can 
see, irreversibility does not show up: the time reversed trajectory is basically 
indistinguishable from the forward trajectory (compare Figs. [3^ and b). Irre¬ 
versibility cannot be observed also when the system is small, i.e. the number 



Figure 1: (color online) Irreversibility in the thermometer model: piston position in time 
for the non-interacting (a) and interacting (b) gas. Black and red curves denote ensemble 
averaged and single-realization trajectory, respectively. Blue horizontal lines denote the equi¬ 
librium values in the one-dimensional non-interacting case. Insets: standard deviation, crx{t). 
Simulation parameters: N = 1024, m = 1, M = 50, F = 150, Tq = 10, Xq = 600. In 
the interacting case the pipe cross-section is L = 30 and the interaction intensity Uq = 1. 
Averages are over 2000 (a) and 150 (b) realizations. 


12 



































10® 

10 ^ 

10 ° 

_ ■'O "' 

£ 10 '® 

10 '® 

lO'"* 

10 '® 

10 '® 

0 0.5 1 1.5 2 2.5 3 

t 

Figure 2: (color online) Sensitive dependence on initial conditions in the interacting gas model. 
Typical evolution of the distance between two trajectories of the system starting from two close 

initial conditions -X'(O) and A'^(O), with ||5X(0)|| = “ 10“®. 

The distance ||(5-X’(t)|| increases exponentially with time with rate given by the maximal 
Lyapunov exponent, Ai 6. All the parameters are the same of FiglU 



of degrees of freedom (N) is small. In the last case no notion of typicality can 
be defined: it is even meaningless to speak of far-from-equilibrium initial con¬ 
ditions, as fluctuations are of the same magnitude of mean values. Though the 
evolution is statistically stationary, we cannot define a (thermodynamic) equi¬ 
librium state when N is small. Therefore, Fig. [3] demonstrates the importance 
of having a large number of degrees of freedom and of starting from a very 
non-typical initial conditions for observing macroscopic irreversibility. 

Summarizing, when an experiment is conducted, in eacfQ single realization, 
the evolution of a macroscopic observable is close to the ensemble average and, in 
addition, it exhibits irreversibility, irrespectively of the presence of chaos in the 
system provided that the system is truly macroscopic {N ^ 1) and the initial 
condition is far (enough) from equilibrium. We remark that (microscopic) chaos 
is irrelevant also for dynamical transport properties close to equilibrium (^ . 


3.2. The adiabatic piston 

We now consider the so-called adiabatic piston - a classical problem in non¬ 
equilibrium thermodynamics [Ulilliaiil (see also Ref. [2^ for a pedagogical 


introduction). In this interesting example the approach to equilibrium from a 
non-equilibrium state is characterized by a more complex phenomenology than 
that of the previous example. 


^More precisely almost all. 
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Figure 3: (color online) Evolution from close-to equilibrium initial conditions, (a) and (b), or 
for small systems (c). Piston position X vs time for the non-interacting gas system: (a) with 
N = 1024, To = 10 and Xq = Xf^q + 3cr^; (b) the time reversed trajectory of (a), as marked 
by the arrows; (c) with Af = 4, To = 10, M = 40, F = 15 and Xq = 1.4 ■ Teq. Horizontal 
(blue) lines denote the microcanonical ensemble average position of the piston Xeq. Other 
parameters are as in Fig. [T] 


Ill a nutshell the system is as follows. A thermo-mechanically isolated cylin¬ 
der of length C is partitioned into two compartments by an adiabatic, freely- 
moving wall (the piston) of mass M. Each compartment contains a gas com¬ 
posed of N non-interacting particles of mass m, elastically colliding with the 
walls. Thanks to the absence of direct interaction, we can restrict our analysis to 
one dimension, along the horizontal direction. The system is initialized with the 
piston kept fixed by a clamp at a given position, XqC] the non-interacting gases 
in the left/right (L/R) compartments are both in equilibrium, meaning that 
they are uniformly distributed in the compartments with volumes Vl(0) = XqC 
and Vr(0) = £(1 — Aq), and velocities distributed with the Maxwell-Boltzmann 
distribution at different temperatures the pressures are fixed by the 

non-interacting-gas state equation Pl,r{0)Vl,r{0) = NTl,r{0). Being the pis¬ 
ton adiabatic, until the clamp is present, the two subsystems are in equilibrium 
even if Tl{0) ^ Tfl(O). At t = 0, the clamp is removed and the piston is free to 
move without friction under collisions with gas particles. The non-trivial ques¬ 
tion is to predict the final position of the piston and values of thermodynamic 
quantities. 

A careful treatment [ 2 ^ , within the framework of equilibrium thermodynam¬ 
ics, shows that the system should reach mechanical equilibrium = Pr. How¬ 
ever, the final position of the piston and gas temperatures remain undetermined. 
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Figure 4: (color online) Irreversibility in the adiabatic piston: (a,b) piston position in a single 
realization (red) and ensemble average (black). Inset: evolution of the standard deviation ax- 
(c,d) Ensemble average of the left E];^(t)/N (blue) and right Eji{t)/N (red) kinetic energy per 
particle, and in a single realization (black). Horizontal (dashed) lines denote equilibrium 
values. The splitting in two panels (for short times (a,c) and longer times (b,d)) is just for an 
easier identification of the two regimes discussed in the text. The simulation parameters are 
N = 10®, m = 1, M = 100, C = 2N-, the initial state is defined by Xq = 0.8 with Tl(0) = 40 
and Tji(0) = 80, averages are on 2000 realizations. 


The prediction of the final equilibrium state needs to understand the non¬ 
equilibrium process, occurring after the clamp removal. Feynman argued 
that the system first converges toward a state of mechanical equilibrium with 
Pfj « Pj, (but for small fluctuations), consistently with the equilibrium thermo¬ 
dynamic prediction. Then, pressure fluctuations, which are asymmetric because 
of Ti^ 7 ^ Tr, slowly drive the system toward thermal equilibrium Tr = T^. The 
final position of the piston is = 1/2 with standard deviation = 1/(V8N) 
[2^. The equilibrium temperature, = {Tl{0) + Tr( 0))/2 -|- 0(l/iV), 

can be directly derived from the conservation of energy fixed b y th e initial value 
E = N{{Tl{0) + Tr{0))/2. Despite many attempts [2^, [s^ [2^ [3l| to derive 
Feynman predictions within a consistent analytic framework is a not yet solved 
problem even for non-interacting gases. 

Here, our interest is to show that the scenario for macroscopic irreversibil¬ 
ity so far discussed well applies also to this more complex irreversible process, 
characterized by the two regimes identified by Feynman. 

In Figured we show the irreversible macroscopic evolution of the system by 
monitoring the piston position and the kinetic energy per particle in each com¬ 
partment /N that, when the gases in each chamber are in equilibrium, 

are nothing but half the temperature values. Analogously to the previous sec¬ 
tion, we show both the evolution averaged over many realizations with the same 
initial macroscopic state and a single realization. Panels (a,c) refer to the first 
stage of the evolution ending with the equilibration of pressures; panels (b,d) 
pertain to the second stage in which, while Pl ~ Pr, asymmetric pressure fluc- 
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tuations drive the system towards the final equilibrium state. The insets show 
the time evolution of the standard deviation of the piston position ax (t) which 
behaves similarly to the thermometer model. As clear from the figure in both 
regimes any single trajectory closely traces the average one, a manifestation of 
typicality as previously discussed and a further demonstration of the validity of 
Boltzmann’s scenario for irreversibility, also in this non-trivial example. 


4. Spreading of an “ink” drop 


When an ink drop falls into the water, we observe its irreversible spreading 
and mixing with the fluid. A typical way to describe the phenomenon is in 
terms of the diffusion equation. The idea underlying such approach is to mimic 
the collisions of an ink molecule against water molecules by a stochastic force, 
renouncing to a deterministic description. Another possibility, within the deter¬ 
ministic framework, is to use molecular dynamics, but this can be very heavy 
from a computational point of view. 

Here, we introduce an idealized simple model which can be used to study 
such a phenomenon from a conceptual point of view. We study a discrete¬ 
time high dimensional symplectic map (akin to a high dimensional Hamiltonian 
system) involving 2N degrees of freedom, and 2 auxiliary variables. We consider 
a special case of the system proposed in Ref. [s^, in particular 


( yi{t + l) = yi{t) + €COs[x^{t) - 0{t)] 

I Xi{t + 1) = x^{t) + yi{t + 1) 

I J(t-fl) = J{t)-eY,f^^cos[xj{t)-0{t)], 

[_ 0{t -l- 1) = -f t/(t -f 1). 


(14) 


Each pair {xi,yi) identifies a “particle” {i = 1,..., N)E and periodic bound¬ 
ary conditions on the two-dimensional torus T 2 = [0, 27r] x [0, 27r] are assumed. 
For e = 0, the particles do not interact, while when e > 0 (in our numerical 
examples we use e = 1) particles interact (the “collisions” of water molecules) 
via a mean-field-like interaction, mediated by the variables 9 and J. We em¬ 
phasize that 9 and J do not have a precise physical meaning, they represent a 
simple mathematical expedient to introduce the interaction among particles in 
a symplectic manner. Moreover, the mean field character of the interaction is 
immaterial here and it simply allows fast numerical computation. In the pres¬ 
ence of interactions the system exhibits complex evolutions, as realistic gases or 
liquids in molecular dynamics systems. System da can be shown to be time- 
reversible, see Ref. [33| for a detailed discussion on time reversal symmetries of 
discrete-time dynamical systems). We used a system with interacting particles 
to avoid confusion between the genuine thermodynamic irreversibility and the 
mixing property, Eq. ©. As already stressed in Sec. 12.11 since our system is 


® Notice that xi and yi can be interpreted as the position and momentum of the f-particle, 
respectively. 
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Figure 5: (color online) Irreversible spreading of an ink drop of Nj = 3.2 ■ 10^ particles on the 
Torus T 2 at t = 0,4 ■ 10^, 2.9 ■ 10^,2.33 ■ 10® (in clockwise order from top left). The Nj ink 
particles start uniformly distributed in Qo = [0.3 : 1.3] X [0.3 : 1.3], while the Nw = 10^ solvent 
ones have been thermalized in a previous time integration. The instantaneous occupation n{t) 
is monitored in the (red) box Q centered in (7r,7r) with side vr/S. 


composed of N interacting elements it should be clear that we are dealing with 
a single large systeirr and irot with a collection of different initial coirditions as 
if the particles were non-iirteractiirg and evolving according to a generic mixing 
map of the torus. In this respect, we emphasize that the details of the interac¬ 
tion among the particles are not particularly important provided soirre form of 
interaction is present. 

After several iterations, the system (fHl) reaches an “equilibrium” dynamical 
state characterized by a uniform distribution of particles on T 2 . To mimic 
the spreading of a cloud of “ink”, we split the N particles into Nw particles 
of solvent (water) and Nj particles of solute (ink), with N = Nw + Nj and 
Ni <C Nw- Then, we prepare the initial condition of the system with the Nw 
particles at equilibrium (e.g. after a long integration with Nw particles only), 
and the solute particles uniformly distributed in a small region Qq of T 2 (top 
left panel in Fig. [5]). During the evolution, to measure the degree of mixing, we 
monitor the number of ink particles, n{t), which at time t reside in a given set 
Q C T 2 (the red box Q in Fig. [5]). At equilibrium, when ink is well mixed, the 
Ni particles will also distribute uniformly over T 2 , and thus n{t) will fluctuate 
around Ueq = NiA{Q)/A{T 2 ), where A{Q) is the area of the subset Q. 

It is instructive to compare (see Fig. El) the behavior of n{t) for a single 
trajectory with the average (n(t)), computed over an ensemble of many inde¬ 
pendent releases of the ink drop, with the water in different (microscopic) initial 
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Figure 6: Instantaneous occupation n(t)/neq of the set Q (blue, fluctuating curve) and its 
average {n(t))/rieq (black, smooth curve) over 500 independent initial conditions starting from 
Qq: (a) Ueq = 0.3 (drop with very few particles, Nj = 8 and Nw = 2500) and (b) Ueq = 10^ 
(drop with many particles Nj = 2.5 x 10“^ and N\y = 10®). 


conditions arbitrarily chosen in the equilibrium state. Moreover, we study the 
difference between the case Nj ^ 0(1) (Fig. [5^) and Ni 1 with Nj <C Nw 
(Fig. IBJa). It is important to realize that while the latter case {Nj >> 1) the 
ink drop can be considered a macroscopic object, in the former {Nj ^ 0(1)) it 
cannot. In both cases, we observe that {n{t))/neq increases monotonically with 
t, asymptotically approaching 1. However, a dramatic difference emerges if we 
look at the single realization. For a (macroscopically well defined) drop with 
Nj :S> 1, the single trajectory closely follows the average one (Fig. [Bb), and we 
can define an irreversible behavior for the individual drop. Conversely, when 
Nj ^ 0(1), the single trajectory is indistinguishable from its time reverse one 
(Fig.|B^) and strongly differs from the average one. The latter apparently shows 
a form of irreversibility, but it is thus a mere artifact of the average over the 
initial distribution and the special initial condition. We stress that, the lack of 
irreversibility in this case is due to the fact that, being Nj small, n(t) cannot be 
considered a macroscopic observable even if the system water plus drop is large 
{N >> 1), as n{t) depends only on the few “molecules” of ink. 

5. Final Remarks 

In this work, with the help of numerical simulations of simple, yet non-trivial, 
Hamiltonian models, we revisited some of the basic aspects of Boltzmann’s 
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interpretation of irreversibility. It is worth concluding by listing some of the key 
elements underlined by our simple investigation. 

1. Irreversibility is observed and must be defined in a single macroscopic 
body. This implies that averaging over all the possible initial conditions is 
unnecessary both at a practical and conceptual level, as perfectly obvious 
to experimentalists. 

2. Crucial to observe irreversibility is the choice of the initial condition, which 
has to be very “unlikely”, that is sufficiently far-from equilibrium. Indeed, 
even in a large-system, irreversibility does not show up in a trajectory 
starting from initial conditions chosen close-to-equilibrium (see Fig. [5Ja, 
and b). 

3. Irreversibility is a property of macroscopic bodies, i.e. of system with a 
large number of components N :$> 1. Indeed, the large N condition of 
a system grants that it develops a “typical” behavior, meaning that the 
features of a single system are close to their averages. 

4. The presence, or absence, of chaos is not relevant. Chaos plays a role in 
mixing, which is surely a form of “irreversibility”, but which has nothing 
to do with the second law. 

All the irreversible behaviors in the approach to equilibrium that we observed in 
the examined examples clearly confirm the above conceptual framework when¬ 
ever the system is composed of a large number of particles and the observables 
are macroscopic, i.e. depend upon a large number of degrees of freedom. Con¬ 
versely, when either the number of particles is small or the observed quantity 
depends on few degrees of freedom, we are unable to identify a clear trend 
towards equilibrium and we cannot determine the time arrow. 
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